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ABSTRACT 



The first in a series of studies, requested by the Reading 
Recovery Advisory Council of South Carolina, an exploratory study identified 
and measured the systemic effects of Reading Recovery on the districts, 
schools, programs, teachers, and students in South Carolina who are touched 
by it. Subjects, 701 first-grade teachers, second-grade teachers, 
administrators, Reading Recovery teachers, Reading Recovery teacher leaders, 
and Reading Recovery teachers in training, completed a questionnaire. Results 
support the assertion that changes in the literacy level of children who 
participate in Reading Recovery influence not only the child and the teacher, 
but provide a positive school -wide impact by inspiring the development of new 
instructional goals, enhancing the professional development of all teachers, 
reducing the need for special education, and improving overall school 
achievement in a cost-effective manner. In addition, the Reading Recovery 
program produced positive teacher change because it was a school -based model 
in which teachers learn while they were teaching children and interacting 
with peers and mentors who were also working in the program. (Contains 12 
references; appendixes contain data and a path model.) (RS) 
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Introduction 

This is the first in a series of research studies requested by the Reading 
Recovery Advisory Council of South Carolina. This study takes an exploratory 
approach to identifying and measuring the systemic effects of Reading Recovery on 
the districts, schools, programs, teachers, and students who are touched by it. 

Method 



Participants 

By 1996, 4,607 first grade students were served by 563 South Carolina 
Reading Recovery teachers since the program’s inception in 1988. This study targets 
the Reading Recovery teachers, classroom teachers, and administrators whose 
students were participants in the program. 

Instrumentation 

In the Spring of 1996, a research team consisting an educational psychologist, 
a Southeast Reading Recovery trainer and a cadre of five Reading Recovery teacher 
leaders designed the framework of the survey used here to determine the impact of 
the program in the state. The resulting survey produced 48 items on a Likert scale 
(1= Strongly Disagree, 5 = Strongly Agree), eight of which were dropped due to 
evidence of ambiguity. The respondents’ summated scores for the forty items were 
confirmed with principal components to define nine unidimensional scales (District 
Support, Cost Effectiveness, Staff Development, Special Ed, At Risk, Program Fit, 
Teacher Change, Child Attitude Change, and Child Reading Change). Indicator items 
defined by scale, with corresponding Cronbach’s alpha coefficients ranging from .52 to 
.88 are included in Appendix A. 
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Data Collection 

In the Summer of 1996, Reading Recovery (RR) teachers and teacher leaders 
volunteered to receive the survey by mail and agreed to distribute them to RR 
teachers, administrators and classroom teachers in their districts. A total of 271 
first grade teachers, 182 second grade teachers, 62 administrators, 294 RR teachers, 
14 RR teacher leaders, 7 RR teachers in training, and 13 of undeclared status 
returned completed surveys (total N = 843 ). With pairwise deletion of missing data 
due to non-response on one or more items, a conservative estimate of 701 was used 
as a sample size in conducting tests of significance. 

Data Analysis 

The Model. The path model shown in Appendix B was analyzed using the 
Linear Structural Relations computer program LISREL, Version 7.1 (Jorescog & 
Sorbom, 1989). Causal connections were hypothesized among six scales serving as 
observed independent variables (District Support, Cost Effectiveness, Staff 
Development, Special Ed, At Risk, and Program Fit) and three scales serving as 
observed dependent variables (Teacher Change, Child Attitude Change, and Child 
Reading Change). The LISREL input matrix comprised of pairwise correlations 
between all nine scales is found in Appendix C. Estimates of direct, indirect, and total 
effects are found in Appendices D.l and D.2. 

Interpretation 

Cost Effectiveness was perceived as the strongest determinant of Program Fit 

(the degree to which the RR program fits within the framework of everyday school 

activities). The attitude that Reading Recovery fits within daily school scheduling is 

causally related to the decision to support state and district funding for RR. In 
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serving individual students, Reading Recovery was considered to be at least as cost 
effective as placement in special education or f^etention. These results support the 
contention that decreased referrals to special education, remedial programs and 
decreased retention rates make a fully implemented Reading Recovery extremely 
cost effective, and that one cannot afford not to have the program in school (Dyer & 
Binkney, 1995; Lyons & Beaver, 1995). 

District Support , the degree of commitment by district personnel to fund, staff, 
and promote Reading Recovery has a direct effect on teachers’ perception of program 
fit. 

Staff Development , which measures feelings about the impact of Reading 
Recovery on district practices in training and evaluating teachers, is weakly but 
significantly related to Program Fit. This weak relationship may be due to the notion 
that rigorous teacher evaluation standards in Reading Recovery training are 
perceived by classroom teachers as threatening, and cause them to react adversely. 
Fullan (1993) described behaviors relevant to this phenomenon as the 
“implementation dip”, which occurs when teachers who are asked to change often do 
not do so without resistance and sometimes revert back to more familiar methods of 
teaching. 

Staff Development directly influences respondents’ attitudes ( Special Ed ) that 
RR contributes to decreased referrals to special education, changes expectations for 
all remedial programs, and contributes to cooperation between RR and classroom 
teachers when dealing with challenging students. Staff Development also indirectly 
affects Special Ed through its influence on Program Fit. 

Reading Recovery, or any program no matter how effective it is, cannot 

compensate for poor classroom teaching. One of the successful outcomes of the 

Reading Recovery training model is that many of the underlying principles and 

theories of the program can be used in providing effective staff development 

programs for classroom teachers. Fountas and Pinnell (1996) stress the importance 
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of “good first teaching” which can be supported by the training of classroom teachers 
within the framework of Reading Recovery theory and practice. 

Program Fit directly influences Special Ed, and At Risk (increased parental 
school involvement due to RR, decreased retention rates at the primary level, RR 
team support in decision-making about at-risk students, and teacher sensitivity to 
students’ lack of experience in learning situations). 

Teacher Change, specified as one of the three outcome variables in the model, 
is directly influenced by Program Fit, At Risk, and Special Ed. Teacher Change is 
defined as a teacher’s improvement in kid-watching skills, independence in problem- 
solving, theory change in how children learn to read, and feeling of comfort in seeking 
peer advice. Teacher Change is causally related to the outcome variable. Child 
Attitude Change , defined as improvement in self-concept and attitude about school, 
confidence in reading ability, and the degree to which the child acts as a positive role 
model for others and takes responsibility for his own learning. Its non- significant 
direct relationship to Child Reading Change is most likely due to moderately large and 
significant mean differences between the attitudes of classroom teachers and RR 
teachers on this variable, _L (670) = 14.24, p < .01. A significant positive indirect 
effect of Teacher Change on Child Reading Change appears when the mediating 
variable of Child Attitude Change is taken into account. 

Child Reading Change , the most important outcome variable, is defined 

as the ability of the successfully discontinued RR child to internalize independent 

reading strategies, problem-solve independently, show active involvement in selecting 

his own reading materials, write and generally function independently in the 

classroom, and continue to read at or above the class average. The strong direct 

causal relationship between Child Attitude Change and Child Reading Change 

suggests that only children who are able to maintain high levels of internal motivation 

are likely to demonstrate sustained levels of reading achievement following 

discontinuation. These results supports Kohn’s notion that a child’s level of internal 
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motivation is affected by his feelings of self (1994) . A child’s internal motivation 
may be at risk if he is placed into a classroom where the teacher does not view him as 
“recovered”. 



Conclusions 

The results of this study support Clay’s assertion that changes in the literacy 
level of children who participate in Reading Recovery influence not only the child and 
the teacher, but provide a positive school-wide impact by inspiring the development of 
new instructional goals, enhancing the professional development of all teachers, 
reducing the need for special education, and improving overall school achievement in a 
cost-effective manner (Shanahan & Barr, 1995). 

In addition, the Reading Recovery Program produces positive teacher change 
because it is a school-based model in which teachers learn while they are teaching 
children and interacting with peers and mentors who are also working in the program 
(Smith-Burke & Jaggar, 1994). Reading Recovery's staff development model is based 
on innovative, yet common sense concepts for maximal teacher learning. 

Our model reflects the practice obseiwed in South Carolina’s Reading Recovery 
programs where school management teams provide a means of communication 
about program effectiveness. The teams, comprised of a building administrator, 
trained Reading Recovery teacher, classroom teachers, special education personnel, 
and other supportive staff members, make decisions about effective implementation 
of Reading Recovery and disseminate information about the program’s outcomes in 
their schools. 



Systemic Effects 6 



References 



Clay, M. (1994). Reading Recovery: The wider implications of an educational 
innovation, literacy teaching and learning . 1(1), 121-141. 

Dyer, P., & Binkney, R. (1995). Estimating cost-effectiveness and educational 
outcomes: Retention, remediation, special education, and early intervention. In R. L. 
Allington, & S. A. Walmsley. No quick fix: Rethinking literacy programs in America's 
elementary schools (pp. 61-77). New York: Teachers College Press; Newark, DE: 
International Reading Association. 

Fountas, L, & Pinnell, G. (1996). Guided reading: Good first teaching for all 
children . Portsmouth, NH: Heinemann. 

Fullan, M., (1993). Change forces: Probing the depths of educational reform . 
Bristol, PA: Falmer Press. 

Gaffney, J., & Paynter, S. The role of early literacy interventions in the 
transformation of educational systems. Literacy Teaching and Learning . 1 (1), 23 - 
29. 



Joreskog, K. & Sorbom, D. (1989). LISREL . Chicago, IL: Scientific Software. 
Kohn, A. (1994). The truth about self esteem. Phi Delta Kappan . 76(4). 272- 

283. 



Lyons, C., & Beaver, J. (1995). Reducing retention and learning disability 
placement through Reading Recovery: An educationally sound, cost-effective choice. 
In R. L. Allington, & S. A. Walmsley. No quick fix: Rethinking literacy programs in 
America's elementary schools (pp. 61-77). New York: Teachers College Press; 
Newark, DE: International Reading Association. 

Lyons, C., Pinnell, G., & DeFord, D. (1993). Partners in learning: Teachers and 
children in Reading Recovery . New York: Teacher's College Press. 

Shanahan, T., & Barr, R. (1995). Reading Recovery: An independent 
evaluation of the effects of an early instructional intervention for at-risk learners. 
Reading Research Quarterly . 30 (4), 958-996. 

Smith-Burke, M., & Jaggar, A. (1994). Implementing Reading Recovery in New 
York: Insights from the first two years. In E. H. Heibert & B. M. Taylor (Eds.), 
Getting reading right from the start (pp. 63-84). Boston: Allyn and Bacon. 

Tharp, G. & Gallimore, R. (1991). Rousing minds to life: Teaching, learning and 
schooling in social context . New York: Cambridge University Press. 



O 

ERIC 



8 



Systemic Effects 7 



c 

QJ 



o 

ERIC 



12 

(U 

E 

>^l 

o 

o 

a. 



C 

o 

a. 

cx 

3 

C/5 

ts 

•£ 

5 



■o 

■o 

cd 

C:U[)| 

.5 

'5 

X) 

<u 

c 

■o 

i 



W) 
w)|.S 



<u 



*8 
o 

Cl| U)| 

.S 

*c 

O 

c 
o- 

cd 

d> 

c3 

o 

oJ 



<u 

> 

0 
u 
lu 

bX){ 

c 

1 

<u 



W) 



CU3 



<u 



C/) 

t: 

o 

a, 

a 

.5 

■o 

<u 

V) 

3 

V5 



(L> 

> 

O 

u 

OJ 

Qc^ 

.S 

•a 

cd 

(U 

cc: 



<u 

> 

o 

CJ 

(U 

OC 

W) 

c 



*o 

fd 

<u 

Qc^ 

W)j 

g 

'c 

o 

cx 

3 

uo 

O 



W) 



■o 

§ 

>A 

Urn 

o 

<L> 



<U 

> 

o 

CJ 

<U 

W)l 

g 

■5 

cd 

(U 

OC 

c 

o 

•a 

00 

cd 

x> 

c/: 

<u 

c/2 

k. 

3 

O 

CJ 

c 

E 

o 

0> 

> 

(L> 

•a 







00 






■o 






c 






2 






4_j 






o 






*u! 












’■5 












2 






X 






c 




c 


dJ) 




<u 


2 




E 


E 




CD 


CJ 




CJ 


1 




rd 


c 






o 




CL 


c 




C 


X 




.2 






E 


‘5 




CJ 


f— 




3 


c 




“O 


r3 


c 


o 


u. 


o 






2 


P 


c 

<u 


’5 


CL 




K 

CO 


b 


CO 

cd 




> 

o 


t> 


O 


CJ 


> 


> 


o 


*3 




QeC 


CJ 

2 


G 

2 


C5JQ 




^g 


<U 


'o 


’■5 






r3 


CO 


00 


<u 


O 

CJ 


O 

CJ 


QeC 




CO 

cd 


4) 

X 


00 


CO 


k. 




• “ 


,o 








> 

O 

CJ 

(U 


<u 

> 

o 

CJ 

<u 


"O 

c 

,3 


QeC 


QeC 


2 






E 


g 


g 


CO 


''S 


'"3 


DO 


Cd 


rd 


C 


<L> 


o 




QeC 


QeC 


c 

(L> 


c 

<D 


c 

o 


E 

00 


“O 


2 


3 


3 


3 




;y2 


00 


O 


rd 


!d 


rd 


3 


3 


<L> 


2 


2 


2 


*> 


*> 


<L> 


’■5 


’■5 


•£ 


,S 


C 








X 


(U 


x> 


o 


X 


X 


CL 






CX 


k. 


k. 


3 


o 


o 


CO 


Uu 


Uu 




On 






vq 






CO 






V2 






o 






c 






<D 






> 






o 






2 












uu 






w 












o 






U 









D 




0^. 




1> 




X 




P 








o 




* c 








00 




'■5 


C 


k- 


2 


o 


E 

CL 


_g 


2 


c 


<u 


o 


> 


*3 


X) 


rd 


*o 


3 




> 


3 


OJ CO 


CO 


«- E 


00 


oj o 


2 


•is 


’> 


b 




^ 4^ 


CJ 


^ 2 


’C 


4^ O 


00 


*> E 


'■o 


<U DO 


k- 


^ .E 


3 




O 






^ 2 


rs 






0-) 


X ^ 


w C 


X 


-o ^ 


-D 

(U 


DO^' 


DO 


S.2 


C 


X CO 


rd 


O ore 


X 


CJ 


o 


4J CO 


CO 

rd 

X 


Is 


■ 


c 


x> 

"O 


•H 8 


c 




E 


CJ &0 

2 .E 


DO 


CL 3 


.E 


c .E 


‘c 


o ^ 




• — c 


3 

u. 


E o 




3 ^ 


u. 




X) 


rd 


X 


> .3 


CJ 


4J CO 


rs 




2 


4J 








CJ g 


u. 


3 O 


<D 


CJ X 


> 


^ CJ 


C 




CJ 

Qe^ 


8-S 

o 2 


DO 


2 o 


C 


2 c 


— 


De^ •- 

tA. 


rd 


DO £ 




•E 2 


0^ 








^ 2 
(u 2 
0^ CL 


CO 




cq 








c 




<D 




E 




CL 








4^ 




> 




4J 




Q 








cd 








CO 





E 

c 

c 

3 

CJ 

3 

T3 

OJ 

“E 

*5 

o> 

Cl| 

00 



rt 

5 

00 



<u 

> 

CJ 

o; 

t5()l 

g 

rd 

<U 



■o 

<u 

c 

cd 

X 

CJ 

X) 

> 

3 

X 



<u 



S' 

<u 

> 

o 

CJ 

d> 

OC 



^■r 

■§ 

Oe:: 



CJ 

Cd 



(U 

■S 

rd 

k. 

<L> 

O 

c 

<u 

*c 

X 

<L) 



CJ 

E 

•S 

<u 

N 

■l 

o 

CJ 

a 



c /2 

Cd 



> ^ 

o c 

^ a 

oc 2 

Cfllc 

g CJ 

“5 

Cd w 

0^ 2 

c ^ 

— <u 

c o 

<1^ *3 

l-s 

c 9- 

cd 



o 

c/2 

00 

(U 



<D 

> 

O 

CJ 

<u 

Ck:: 

&D 

.s 

’■a 

rd 

<U 

Cc^ 

■a 

2 

3 

■o 

<u 

x: 

CJ 

CO 

Urn 

<u 

> 

o 



c /2 

C 

o 



<u 

> 

0 

CJ 

<u 

cc: 

oj:)| 

c 

1 

<u 

)Q^ 

Urn 

<u 

o 



*c 

c 

*c 

CL 

<u 

2 

o 

c 

o 

■a 

00 

2 

3 

■o 



X) 

> 

E 



*c 

•g 

Ouj 

<u 

-X 

2 

o 

c 

o 

■a 

*o 

o 

X 

u 

CO 



cd 

<u 

c 

<u 

*0 

o 

c 

CJ 

00 

in 

cn 



CO 

C 

O 

c /2 

CO 

2 

0^ 

Qc^ 

<u 

> 

'C 

CJ 

E 



c 

a 

2 

2 

CJ 

O 

2 

o 

W) 

.5 

2 

■a 

(D 

X 

u 

CO 

C 

o 

2 

E 

k 

o 

o 

CJ 

c /2 

<u 

X 

CJ 

cd 

2 

E 

o 

p 



CJ 

cd 



> 

o 

CJ 

(D 

OE^ 

CUD 

■S 

*a 

cd 

(U 

Qe^ 



O 

g 

CO 

E 

cd 



2 

G 

B. 

C/2 



2 

2 

E 

CL 

E 

o 

CJ 

CO 

h 

<o 

> 

o 

o 

4; 

t>Cl| 

S 

■8 

<i> 

qc 



2 

CJ 

■a 



2 

<u 

x: 

8 

2 

<u 

> 

o 

CJ 

(D 

Oe^ 

CiO 

s 

*8 

(U 

0^ 



\o 



ou 

E 

cd 

Un 

OJQ 

P 






UJ 

«-r»4 



2 



5 

>=• 

fiL 



o 

C/3 

UJ 

m 



©2 












■d 

a 

E 












0 












E 

c 

E 

2 

2 

0 


D 

E 

*0 

D 

c 










2 


li 


Items 
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Appendix D.1 



Tables 1-3. Direct, Indirect, and Total Effects & Standard Errors 
of District Support, Cost Effectiveness, and Staff Development on 
Reading Recovery Outcome Variables 





Table 1. District Support 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Proaram Fit 


.234* 


.028 






.234* 


.028 


At Risk 






.218* 


.026 


.218* 


.026 


Special Ed 






. 108* 


.015 


. 108* 


.015 


Teacher Change 


-.036 


.026 


.171* 


.021 


. 1 35* 


.032 


Child Attitude Change 






.142* 


.021 


. 1 42* 


.021 


Child Reading Change 






. 1 39* 


.022 


. 139* 


.022 





Table 2. Cost Effectiveness 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Program Fit 


.476* 


.028 






.476* 


.028 


At Risk 






.444* 


.028 


.444* 


.028 


Special Ed 


.194* 


.033 


.219* 


.021 


.414* 


.029 


Teacher Change 






.339* 


.024 


.399* 


.024 


Child Attitude Change 






.366* 


.023 


.366* 


.023 


Child Reading Change 






.367* 


.023 


.367* 


.023 





Table 3. Staff Development 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Program Fit 


.076* 


.032 






.076* 


.032 


At Risk 


.062 


.037 


.071 * 


.031 


. 1 33* 


.032 


Special Ed 


.230* 


.028 


.055* 


.014 


.285* 


.030 


Teacher Change 


.032 


.026 


. 1 47* 


.023 


.179* 


.033 


Child Attitude Change 






.157* 


.024 


.157* 


.024 


Child Reading Change 






. 160* 


.025 


. 160* 


.025 
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Appendix D.2 



Tables 4-7. Direct, Indirect, and Totai Effects & Standard Errors 
of Program Fit, At Risk, Speciai Ed and Teacher Change on Reading 
Recovery Outcome Variabies. 





Program Fit 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


At Risk 


.933* 


.061 






.933* 


.061 


Special Ed 


.157* 


.034 


.304* 


.037 


.461 * 


.042 


Teacher Change 


.225* 


.029 


.507* 


.042 


.733* 


.043 


Child Attitude Change 






.669* 


.044 


.699* 


.044 


Child Reading Change 






.665* 


.044 


.655* 


.044 





At Risk 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Special Ed 


.326* 


.033 






.326* 


.033 


Teacher Change 


.41 5* 


.031 


.085 


.013 


.500* 


.030 


Child Attitude Change 


.332* 


.032 


.246* 


.121 


.579* 


.028 


Child Reading Change 


.022 


.051 


.535* 


.047 


.557* 


.029 





Special Ed 




Direct 


Ind 


irect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Teacher Change 


.260* 


.031 






.260* 


.031 


Child Attitude Change 


. 145* 


.030 


.104* 


.015 


.249* 


.031 


Child Reading Change 


.029 


.037 


.233* 


.036 


.262* 


.031 





Teacher Change 




Direct 


Indirect 


Total 




Effect 


SE 


Effect 


SE 


Effect 


SE 


Child Attitude Change 


.398* 


.033 






.398* 


.033 


Child Reading Change 


.155 


.095 


.309* 


.028 


.463* 


.096 
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